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SUMMARY 1 



Pennsylvania's "Testing for Essential. Learning and Literacy Skills" (TELLS) 
program was instituted during the 1984-85 school year. The program was 
designed as an "early warning system" to identify reading and mathematics 
problems early in a student's school career. In April of 1984 committees of 
Pennsylvania educators selected reading and mathematics objectives to serve as 
the basis for tests to be administered to students in grades 3, 5 and 8. Test 
items to measure these objectives were obtained by contracting with the 
Charles E. Merrill Publishing Company. 

The tests were administered in October of 1984. Committees of reading and 
mathematics teachers used a judgmental process to provide the data needed to 
develop a cut score for each test. Students scoring at or below these cut 
scores became eligible for state-funded remedial instruction. The total nur- 
ber of students tested was 428,958. Approximately 84 percent of these stu- 
dents were from public schools. The remainder were from 725 nonpublic schools 
which participated voluntarily. 

Depending upon the specific test area and grade level, students were required 
to answer correctly between 53 and 63 percent of the items in order not to be 
identified for remedial assistance. The percentages of scores falling at or 
below the cut scores ranged from 20.2 percent for grade 3 mathematics to 28.2 
percent for grade 3 reading. The total number of scores which fell at or 
below the cut scores was 212,113. The total number of students who became 
eligible for at least one remedial program (reading or mathematics or both) 
was 142,177. About 35 percent of public school students and 24 percent of 
nonpublic school students became eligible for at least one remedial program. 
The testing identified 94,461 students for remedial help who were not previ- 
ously being served by ECIA Chapter I, by special education or by the limited 
English proficiency program. 

At all three grade levels, higher percentages of males than females became 
eligible for remediation. As expected, higher percentages of special educa- 
tion and limited English proficiency students than regular students were iden- 
tified. Approximately 67 percent of the reading scores and 63 percent of the 
mathematics scores of Chapter 1 public school students fell at or below the 
cut scores. 

For certain objectives the performance of above-cut students differed greatly 
from that of below-cut students. On the grade 3 reading test the greatest 
difference occurred on the Multiple Meaning Words objective of the Vocabulary 
area. On the grade 5 and grade 8 reading tests the area of Inferential and 
Critical Comprehension was most indicative of such differences. On the grade 
3 mathematics test, above-cut and below-cut students differed most in the 
areas of Problem Solving and Numeration. On the grade 5 mathematics test, 
items measuring multiplication, division and fractions showed the largest dif- 
ferences. And, on the grade 8 mathematics test, the area of Fractions again 
was a major determiner of above cut-below cut differences. 



X The data suiwnarized in this report do not reflect changes in the number of 
students tested due to late make-up testings. They also do not reflect 
revisions made by school district personnel when they discovered inaccuracies 
in their own data (e.g., finding that a particular student should have been 
included in the EMR grouping and was not). After all such changes had been 
made, it was determined that 215,506 students' scores fell at or below the cut 
scores. This figure differs by about 3400 from that shown in this report. 



TESTING FOR ESSENTIAL LEARNING AND LITERACY SKILLS (TELLS) 



Summary of Results - 1984 



BACKGROUND 

Intent and Legislation 

On October 17, 1983, Governor Dick Thornburgh announced his comprehensive edu- 
cational reform package called Turning the Tide: An Agenda for Excellence in 
Pennsylvania Public Schools. Citing the "disturbing . statistic" of 13 per- 
cent of the nation's 17-year-olds not being able to read at the sixth gr^de 
Level, he advocated a competency test for third, fifth and eighth graders 
which would be called "Testing for Essential Learning and Literacy Skills," or 
TELLS. The test would be designed to be an "early warning system" to identify 
reading and mathematics problems early in a student's school career. The sec- 
ond part of the program would make extra help available for students who 
needed it through state-funded remedial instruction. 

In order to institute TELLS, the State Board of Education added Chapter 3: 
Student Testing to its regulations on June 14, 1984. It required all public 
school students in grades 3, S, and 8 to be given a criterion-referenced test 
in reading and mathematics. Nonpublic schools could choose to participate in 
the testing. The program was assured of $26 million in funding ($2 million 
for testing, $24 million for remedial instruction) on June 29, 1984, when the 
Governor signed into law the 1984-85 appropriations bill (Act 7-A-1984). A 
companion bill (Act 93 - 1984) required districts to provide remedial instruc- 
tion programs for students identified by the tests given under the State Board 
regulation, and it set forth the conditions under which the $24 million would 
flow to the schools. Appropriate section* of Act 93 are included in the 
Appendix. 

IMPLEMENTATION 

Selection of a Contractor 

A Request for Proposal for the "Production and Processing of 
Objective-Referenced Individual Student Achievement Tests for Pennsylvania 
Statewide Testing Program" was mailed to 22 potential contractors on January 
19, 1984 in anticipation of the actions by the State Board and the 
Legislature. Five proposals were received by the due date of March 16, 1984. 
After review and evaluation by the staff of the Division of Educational Test- 
ing and Evaluation (ET&E), two of vhe proposals were judged acceptable. The 
final contractor selection, however, wns hased on the selection of the list of 
objectives by a committee of reading and mathematics professionals from across 
the state. This committee met on April 5 and 6, 1984 and recommended that 
objectives from the list submitted by the Charles B. Merrill Publishing Compa- 
ny of Columbus, Ohio* be used as the basis for the tests. 

The contract could nt* be consummated, however, until after the budget was 
approved on June 29, 1984. After the contract was signed, six ET&E testing 
specialists met with Merrill employees in July to select the items which would 
measure each objective. Selection was based on item statistics provided by 
the contractor as well as the specialists 1 judgments about the appropriateness 
of the item for Pennsylvania stuients. At this time, the design process for 
the test administration manuals and *he answer sheets was also begun/ 



Test Administration 



Later in JuLy the districts were notified that the testing dates wouLd be 
October L6 and L7, L984. In August, brochures Listing the objectives were 
sent to each participating school* They were to be distributed to teachers of 
third, fifth and eighth graue students* To nclity parents of the testing, 
districts were encouraged to send home, earLy in September, a Letter explain- 
ing the test and Listing the dates on which the test administration was 
pLanned. A sampLe Letter was suppLied to the districts for this purpose, and 
a Spanish version was made avaiLabie to appropriate districts* In addition, 
brochures in a question and answer format were provided co districts in suffi- 
cient quantities to distribute to parents approximately a week before the 
scheduled testing dates* Guidelines for Testing were developed, and in Sep- 
tember ET&E staff conducted workshops for district and nonpublic school test 
coordinators in each of the 29 intermediate units* 

Test materials were sent from the contractor to the test coordinators who in 
turn distributed them to the participating schooL buiLdings* Teachers, coun- 
selors and principals aLL acted as test administrators, guided by test admin- 
istration manuaLs* Suggested testing times ranged from 65 minutes for the 
Grade 3 reading test to L35 minutes for the Grade 8 mathematics test, aLthough 
the test administrators were advised to "use the flexibility of the time lim- 
its to the students' advantage so that they can show what they have really 
learned* No student shouLd be penalized because he or she is a slow worker. 11 
Between October 16 and 26, more than 353,000 public school students (including 
almost ail categories of special education students) in 2743 school buildings 
and approximately 75,000 nonpublic students in 725 schools (about one-third of 
the state's nonpublic schools) took the test* Answer documents -/ere returned 
to the contractor for scanning and scoring* After aLL answer documents for a 
schooL district were received, that district's materials were processed and 
the reports were generated* Districts began to receive reports in Late Novem- 
ber* 

The Cut Scores 

A cut score divides students into two groups with reference to some purpose or 
criterion* In Pennsylvania, r.he purpose was to identify students who cjuld 
benefit most from additional instruction in reading or mathematics or both* 
The determination of cut scores is a difficult task and one that was undertak- 
en with a great deaL of care* The uLtimate decision about how to determine a 
specific score is a matter of judgment* ALthough procedures have been devised 
to aid in the selection of such scores, judgments are invoLved in every one of 
them* WhiLe the decision is arbitrary, it must not be capricious* That is, 
the procedure employed must address the primary purpose of the program* In 
the case of TELLS, that purpose was to identify students for remediar.ion pro- 
grams* 

The information used to determine the FaLL L984 cut scores was provided by 
committees of Pennsylvania reading and mathematics teachers at a meeting on 
October L0, L984. The 58 individuals were seLected to be a representative 
sampLe of the state's teachers for the two content areas* Since cut scores 
were needed for both the reading and the mathematics tests at each of the 
three grade LeveLs, the teachers were divided into six groups* Each group 
deaLt onLy with one specific grade LeveL and content area. 
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The teachers were, trained to use procedures developed by W.H Angoff (1971) 
for examining the items of a test. Each group of teachers was asked to think 
about the entire group of students in need of remedial help in the subject 
area and at the grade level with which they were concerned. They were then to 
focus their attention only on those who were at the uppermost point of this 
group; in effect , on students on the borderline between those in need of reme- 
dial help and those requiring no remediation. Their instructions were to 
estimate the proportion of these students capable of correctly answering each 
item of the test for which they were establishing the cut score. The sum of 
these proportions across all the items of the test produced a cut score for 
this test as determined by this teacher. The average of these scores across 
all teachers in a group produced the group's determination of the cut score. 
Each cut score was then compared with national results provided by the test 
publisher to ascertain whether a common standard could be adopted. The aver- 
age percentages of items to be answered correctly at the teachers' cut scores 
were, with some slight variation, 16 percent below the percentages answered 
correctly by the national samples for the six tests. The "16 percent below 
national" criterion was therefore adopted as a common standard and each of the 
six cut scores was adjusted to conform to it. 

Table 1 below shows the cut scores for reading and mathematics and some addi- 
tional information about them. As shown, the procedures resulted in cut 
scores which were as close to the "16 percent below national" criterion as 
possible. For example, for Grade 3 reading, the estimated national average 
percentage correct was 72. Subtracting 16 percent from this leaves 56 
percent. A cut score requiring as clo3e to 56 percent correct as possible was 
needed. Taking 56 percent of the 52 test items leads to a cut score of 29 
(.56 x 52 = 29.12 or 29). 

For five of the six tests, the final cut score placements resulted in 3tudents 
being required to answer correctly approximately 60 percent of the items in 
order not to be placed in a remedial program. Both teacher judgments and 
estimated national results led to the conclusion that the eighth grade mathe- 
matics test was more difficult than the other tests. Therefore, students were 
required to answer 53 percent of the items correctly in order not to be 
selected for remedial instruction. 

ALso shown in Table I are the percentages of Pennsylvania public schooL stu- 
dents who qualified for remediation. These figures do not include limited En- 
glish proficiency students or special education students (except speech au4 
language impaired). 

Interpretation and Remediation 

In the meantime, the TELLS Guidelines for Remediation and the funding applica- 
tions were being developed and were sent to districts and to intermediate 
units (which were to serve nonpublic schools) in early December. In addition, 
test interpretation workshops were conducted by ET&E staff in each intermedi- 
ate unit during the first two weeks in December, and workshops on remedial 
Instruction topics were held in IU's which requested them. 
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After information from every district was on file, statewide data were tabu- 
lated* The PDE report to the media incLuded the number of noncategoricaL stu- 
dents tested, the number at or below the cut score and the percentage at or 
below the cut score for each district in each area and at each grade level. 
The report, entitled TELLS - 1984-85 Statewide Test Results, also included the 
same information for nonpublic schools grouped according to intermediate unit. 
Many school districts, encouraged by a "data release packet" distributed by 
the PDE, released their own data in local newspapers* 

Applications for funding for the remedial instruction programs were due from 
districts on January 25, 1985, if the districts wanted the first payment of 
their monies in February* Most districts began their programs in late January 
or early February* Intermediate unit applications, to serve identified stu- 
dents in nonpublic schools, were due two weeks later* After this initial half 
year of remedial instruction, a final report on the operation of each dis- 
trict's program will be required* 



Table 1 
Cut Score Information 



READING 





National 


Percentage 




State Percentage 




Percentage 


Correct 


at 




of Public School 




of Items 


Cut 


Cut 




Student Scores at 


Grade 


Correct 


Score 


Score 




or Below Cut Score* 


3 


72 


56 


29 or 


below 


26.8 


5 


72 


56 


37 or 


below 


20a 


8 


76 


60 


46 or 


below 


24.7 


MATHEMATICS 


3 


78 


62 


39 or 


below 


19.2 


5 


77 


al 


40 or 


below 


26.5 


8 


68 • 


52 


40 or 


below 


22.2 



*The results shown are for only regular students and speech and 
language impaired students* 



DESCRIPTION OP THE TESTED POPULATION 



For grades 3, 5 and 8 combined, 428,958 students were tested. Of this total, 
428,373 took the reading test and 428,626 took the mathematics test. The num- 
ber of students taking both tests was 428,031 or 99. 8Z of those involved in 
the testing. 

Figure 1 shows the total numbers of public and nonpublic schooL students 
tested at each grade level. Also shown are the percentages of the total sam- 
ple represented by each group. 




□ Public = 83. 9* ^Nonpublic * 16. 1% 

Nu/nbtr Ttcttd Number Tttttd 

Gradt 3 - 199. 452 Gr 4 dt 3 - 23.564 

Gradt 5 - 112. 429 Gr*dt 5 - 22.418 

Gr*dt 8 - 138.145 Gr*dt 8 - 22.959 

Figure 1 



At the time of testing, students or their teachers provided information about 
such aspects of the students as their sex, whether they were being served by 
Chapter I and whether they were bein^ served by special education. This 
information was used to produce Tables 2 and 3. It should be remembered when 
examining these tables that each student could be categorized in more than one 
way. Thus, for example, a student being served in a limited English profi- 
ciency program who was also being served in a Chapter I reading program would 
appear in the counts for both programs. 

It was the intent of the Department of Education that all public school stu- 
dents in the third, fifth and eighth grades in the Commonwealth should have 
the opportunity to participate in the testing. This included all limited Eng- 
lish proficient (LEP) and special education students, with the exception of 
those whose mental or physica 1 handicaps would clearly preclude participation. 

Table 2 provides a summary of numbers of public school special education stu- 
dents tested. By adding the figures in the "Total" column for the seven cate- 
gories listed (i.e., speech and language impaired through "other special 
education"), it can be determined that approximately 25,000 public school spe- 
cial education students were tested. 



In an effort to determine how difficult it was for school districts to involve 
such students in the testing, statewide figures on the total number of special 
education students of each category were obtained from the Department's Divi- 
sion of Child Accounting and Subsidy Research. Unfortunately, these figures 
were summed according to four age groupings to fulfill federal reporting 
requirements (ages 3 -5, ages 6 - 11, ages 12 - 17 and ages 18 - 21). 
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Table 2 

Numbers of Public School Students Tested 



READING 





Grade 3 


Grade 5 


oraae o 


Male j 
Female 


55, 


934 


57 


,364 




52, 


84? 


54 


,599 


DO. OJO 


Chapter 1 Reading 


14, 


809 


12 


,225 


"7 A ~JQ 
1 ,4/0 


Chapter 1 Mathematics 


4, 


979 


4 


,672 


3, 130 


Speech & Language Impaired 


3, 


575 


1 


,455 


070 
LI Z 


Learning Disabled 


3, 


503 


4 


,393 


A QAQ 

*» 9 yoy 


Socially & Emotionally 












Disturbed 




453 




642 


77^ 


Educable Mentally 












Retarded 




866 


1 


,035 


1,650 


Hearing Impaired 




130 




99 


168 


Physically Handicapped 




61 




55 


46 


Other Special Education 




424 




350 


162 


Limited' English Proficiency 




836 




769 


971 



MATH 



Total 


Grade 3 


Grade 5 


Grade 8 


Total 


184,487 


56,052 


57,465 


71,150 


184,667 


174,082 


52,902 


54,645 


66,615 


174,162 


34,512 


14,803 


12,235 


- 7,481 


34,519 


l2,7ol 


4,978 


4,674 


loo 

j, 132 


12, 784 


5,302 


3,580 


1,45/ 


272 


5,309 


12,865 


o CO/ 

3 , 584 


4,476 


4,9o6 


13,026 


1 , ooo 


AAA 
HUH 


AAO 


7 70 


1 P*7£ 
I , O /O 


3,551 


884 


1,050 


1,637 


3,571 


397 


135 


105 


168 


408 


162 


61 


55 


46 


162 


936 


437 


363 


163 


963 


2,576 


845 


787 


974 


2,606 



Table 3 

Numbers of Nonpublic Students Tested 



READING 



MATH 





Grade 3 


Grade 5 


Grade 8 


Total 


Grade 3 


Grade 5 


Grade 8 


Total 


Male 1 t 


11,609 


11,044 


11,074 


33,727 


11,612 


11,044 


11,072 


33,728 


Female 


11,853 


11,330 


11,838 


35,021 


11,851 


11,330 


11,836 


35,017 


Chapter 1 Reading 


2,645 


1,640 


541 


4,826 


2,642 


1,641 


541 


4 f 824 


Chapter 1 Mathematics 


1,308 


882 


567 


2,757 


1,308 


882 


566 


2.756 


Speech & Language Impaired 


341 


118 


39 


498 


342 


119 


39 


500 


Learning Disabled 


54 


57 


31 


142 


54 


56 


31 


141 


Socially & Emotionally 
















12 


Disturbed 


4 


4 


4 


12 


4 


4 


4 


Educable Mentally 


















Retarded 


7 


2 


2 


11 


6 


2 


2 


10 


Hearing Impaired 


11 


15 


3 


29 


12 


15 


3 


30 


Physically Handicapped 


4 


7 


5 


16 


4 


7 


5 


16 


Cther Special Education 


63 


69 


35 


167 


64 


70 


35 


169 


Limited English Proficiency 


335 


314 


305 


954 


336 


317 


306 


959 
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The sum of males and females should equal the total tested for the grade level. However, at ^ach level some 
studente did not indicate their sex. Students were also asked to indicate whether they were "Black", "White" 
or of another race. Because so many students did not indicate this, the numbers obtained were not reported. 
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To produce the desired comparative information, it was necessary to assume 
that students were distributed equaLLy across the age LeveLs of each grouping. 
Since both grade 3 and grade 5 students wouLd be incLuded in the age 6-11 
grouping 9 the total for this grouping was multiplied by one-third (two age 
levels out of six) to estimate the number of students who were available at 
two of the three grade levels. Since grade 8 students would be included in 
the 12 - 17 grouping, this total was multiplied by one-sixth (one age level 
out of the six in the grouping). The eighth grade estimate was added to that 
for grades 3 and 5 to provide an overall estimate of numbers of special educa- 
tion students of each category, who could have been involved in the testing. 

The total estimate of numbers of special education students who could have 
been tested was 40,000. As was stated above, 25,000 special education stu- 
dents were tested. Dividing this figure by 40,000 leads to the conclusion 
that approximately 63 percent of the available special education students were 
tested. 

However, a similar analysis carried out for each category argues against the 
accuracy of this* finding. The following percentages were computed: educable 
mentally retarded (73 percent of the available students tested); hearing 
impaired (72 percent tested); learning disabled (88 percent tested); phys- 
ically handicapped (83 percent tested); socially and emotionally disturbed (72 
percent tested); speech and language impaired (32 percent tested); and al- 
most four times as many students were identified as "other special education" 
as were on record for Pennsylvania schools. 

Two conclusions seem warranted from these results. First, some students v:ho 
should have been categorized into one of the six specific categories were 
identified as "other special education" students at the time of TELLS testing. 
Second, since almost all speech and language impaired students have minimal 
handicaps, there would be no reason to exclude them from testing. It appears 
that it was very common across the state for district personnel to forget to 
indicate that such students* were being served by special education programs. 

If it is therefore assumed that almost all speech and language impaired stu- 
dents were tested, this increases the number of tested special education stu- 
dents by about 11,000. The total which results, 36,000, is approximately 90 
percent of the available sample. 

An estimate of the numbers of limited English proficient students in public 
schooLs was requested from the Department's Division of Communications, Math- 
ematics and Instruction. The figure obtained was 25,000 in kindergarten 
through grade 12 for the 1983-84 school year. 

To use this estimate it was again necessary to assume that equal numbers were 
enrolled at each grade level. By multiplying 25,000 by 3/13 (3 grade levels 
tested out of 13 available), an estimate of 5800 possible students to test was 
computed. As shown in Table 2, about 2600 LEP students were tested. Dividing 
2600 by 5800 leads to the conclusion that approximately 45 percent of the LEP 
students enrolled at the three grade levels were tested. 

TELLS results were reported back to school districts both for each individual 
group shown in Tables 2 and 3 and in terms of two overall groupings. These 
groupings were termed "categorical" and "noncategorical ." Categorical stu- 
dents included limited English proficiency students and special education stu- 
dents with the exception of speech and language impaired. Noncategorical 
students, then, included speech and language impaired (considered to be mini- 
mally handicapped) and all other students tested. 
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These groupings were deveLoped for reporting purposes only* The intent was to 
provide districts with results which would have most meaning to them when com- 
pared with the results of their usual testing programs and also to provide a 
reference group (noncategorical) which would be most like that employed by the 
test company in developing their estimated national norms. 

Table 4 provides a summary of the numbers of categorical and noncategorical 
students tested. Approximately 6.2% of the public school students tested and 
1.9% of the nonpublic school students tested were considered categorical. 

At the time of testing there were 2,743 public schools with students of at 
least one of the three TELLS grade levels. There were also 1,492 nonpublic 
schools with students of at least one of the three. 

All public schools with students at the appropriate grade levels were required 
to participate in the testing. Grade 3 students from 2,013 schools, grade 5 
students from 1,857 schools and grade 8 students from 749 scnools were tested. 

Nonpublic school participation was voluntary. A total of 725 (48,6 percent) 
of the 1,492 possible schools participated. Table 5 summarizes information on 
numbers and percentages of schools and students participating. Over 70 percent 
of nonpublic students were tested. These students were from 48.7 percent of 
the schools with grade 3 students, from 49.2 percent of the schools with grade 
5 students and from 59.6 percent of the schools with grade 8 students. 



Table 4 
Numbers of Categorical 
and Noncategorical Students Tested 



Public Schools Nonpublic Schools 



Grade 


Subject 


Noncate- 
gorical 


Cate- 
gorical 


Total 


Noncate- 
gorical 


Cate- 
gorical 


Total 


3 


Reading 
Mathematics 


102,992 
103,032 


6,204 
6,338 


109,196 
109,370 


23,083 
23,081 


471 
472 


23,554 
23,553 


5 


Reading 
Mathematics 


104,944 
104,960 


7,269 
7,401 


112,213 
112,361 


21,946 
21,945 


466 
468 


22,412 
22,413 


8 


Reading 
Mathematics 


129,388 
129,339 


8,653 
8,639 


138,041 
137,978 


22,576 
22,571 


379 
380 


22,955 
22,951 


Total Reading 
Total Mathematics 


337,324 
337,331 


22,126 
22,378 


359,450 
359,709 


67,605 
67,597 


1,316 
1,320 


68,921 
68,917 



Table 5 

Participation of Nonpublic Schools 
and Students 



Number of 

Schools with Number of 

Students at Schools Percent Number of Number Percent 

Each Grade Partici- Partici- Students Partici- Partici- 

Grade Level pating pating in State pating pating 



3 1,449 706 48.7 33,090 23,564 71.2 

5 1,430 703 49.2 31,160 22,418 71.9 

8 1,098 654 59.6 31,540 22,958 72.8 
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PROPERTIES OP THE TESTS 



The TELLS instruments were constructed according to an objective-referenced 
model. Committees of Pennsylvania educators chose the specific objectives to 
be measured (see Appendix C). Items to measure these objectives were selected 
from the Charles E. Merrill Company's item bank. 

Thus, the tests were "custom made 19 in the sense that the particular items se- 
lected had never all been placed on the same test form. Each item chosen had 
been tried out with a nationally representative sample of students at both the 
grade level at which it was used for TELLS and at the grade levels above and 
below this. But the tests as wholes had never been used with such samples. 

A major strength of this approach was the degree of flexibility possible. 
Pennsylvania's tests were composed of items measuring only objectives which 
Pennsylvania educators believed almost all students would have been taught by 
October of tha grade level of their testing. 

What was lost through the approach was some degree of precision in the 
national norms. The norms were estimated using the complex procedures of the 
Rasch model. 3 These procedures took into account the available information 
about a student's performance on the items he or she answered and information 
about the difficulty of each item for the students who responded to them to 
estimate how well a normative sample would hava scored had they responded to 
all the items on a specific TELLS instrument. 

The intent of the testing should be kept in mind when examining the properties 
of the tests. The major intent was to identify students in need of remedial 
help* It was not to learn how Pennsylvania's achievement or the achievement 
of individual students compared with a national sample. The items selected 
were ones which should not have been difficult for most students and, indeed, 
this proved out when the tests were administered in Pennsylvania. 

As with any testing program, a note of caution must be given. The objectives 
tested are representative of those taught; they are not the only objectives 
taught in reading and mathematics. The items used to measure the objectives 
are from a universe of items that could be used to measure them. These facts, 
together with the usual cautions of time and conditions when the tests were 
administered, must be considered when interpreting TELLS results. Test scores 
should not be the only criteria used to evaluate a total educational program. 

Table 6 provides a summary of the properties of the tests developed for TELLS. 
The K-R 20 internal consistency reliability coefficients were quite high; all 
were above .90. 'The standard errors of measurement were low when compared 
with the tests 1 variabilities, shown as standard deviations. 

Also shown in Table 6 are the test means for Pennsylvania students and the 
estimated national means for each test. For five of the sir tests, 
Pennsylvania students 9 means were higher than the national means. For the 
sixth test, grade 5 mathematics, Pennsylvania students scored approximately 
two points below the estimated national mean. 



5 See Wright, B. D. and Stone, M. H. Best Test Design . Chicago: MESA Press, 
1979. 
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Table 6 

Test Properties for Noncategoricai 
Pennsylvania Public School Students and 
Estimated Means for a National Sample 



Standard 





No. of 


Nn of 






Error of 




esc Lmacea 




Subject 


Test 


Students 




Devia- 


Measure- 


Relia- 


National 


Grade 


Area 


Items 


Tested 


Mean 


tion 


ment 


bility 


Mean 


3 


Reading 


52 


102,992 


36.51 


10.37 


2.89 


.92 


35.91 




Mathematics 


63 


103,032 


47.93 


9.87 


2.93 


.91 


47.04 


5 


Reading 


65 


104,936 


48.25 


11.94 


3.13 


.93 


45.17 




Mathematics 


66 


104,952 


47.20 


11.12 


3.20 


.92 


49.58 


8 


Reading 


76 


129,388 


55.48 


13.43 


3.45 


.93 


54.04 




Mathematics 


78 


129,339 


53.48 


15.09 


3.58 


.94 


52.01 
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TESTING RESULTS FOR NONCATEGOR1 CAL STUDENTS 
AMD FOR TUB TOTAL GROUP OP STUDENTS TESTED 



Since the overall purpose of the TELLS program is to determine which students 
in grades 3, 5 and 8 are in need of remedial help, the most meaningful way tc 
report results is in terms of the numbers and percentages of students who 
scored at or below the cut scores. This section summarizes these results for 
the total group of students tested and for noncategorical students. 

Two other types of analyses of noncategorical student results are presented in 
this section. First, the distributions of obtained scores will be described 
both verbally and graphically. Second, the results obtained for each objec- 
tive will be shown as a means of describing the statewide results more fully. 

Numbers and Percentages of Students Scoring At or Below Cut Scores 

Table 7 shows the numbers and percentages of the total group tested whose 
scores were at or below the cut scores. Table 8 provides a similar summary 
for noncategorical students. As would be expected, the percentages of 
noncategorical student scores at or below the cut scores were less than for 
the total group tested. Depending upon grade level and subject area, between 
19 and 27 percent of noncategorical public school student scores fell at or 
below the cut scores. The percentages of students eligible for remedial help 
were less in nonpublic schools than in public schools. 

Tables 7 and 8 provided information about the numbers and percentages of 
scores which fell at or below the cut scores. There was no attempt in these 
tables to describe how many individual students became eligible for remedial 
help, i.e., how many students became eligible for at least one of the two pro- 
grams. These results are shown in Tables 9 (total sample) and 10 
(noncategorical students). 

Taking ^the results shown in Tables 7 through 10 into consideration, the fol- 
lowing can be said: 

o TELLS testing resulted in an overall total of 212,113 student 
scores at or below the cut scores (109,741 reading scores and 
102,372 mathematics scores). Of the total group of scores at 
or below the cut scores, 189,721 occurred in public schools 
and 22,392 occurred in nonpublic schools. 

o The total number of students eligible for at least one remedial 
program (reading or mathematics or both) was 142,177 (125,866 pub- 
lic school students plus 16,311 nonpublic school students). About 
35 percent of public school students and 24 percent of nonpublic 
school students became eligible for at least one remedial program. 

o About 50.7 percent of the public school students -who were eligible 
for remedial help were eligible for both reading and mathematics 
help. About 37.3 percent of tho nonpublic students eligible for 
remedial help were eligible in both areas. 

o A total of 107,011 noncategorical public school students and 
15,558 noncategorical nonpublic school students were eligible 
for at least one remedial program. 
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Table 7 
Total Tested Sample 
Numbers and Percentages of Scores 







At 


or Below Cut Scores 












Public Schools 


Nonpublic 


jcnoois 


Total Sample 


Grade 


Subject 


»j \j tc a 

Below Cut 
No. 


Scores 
X 


Scores 
Below Cut 
No 


at or 
Scores 
X 


Q /* r\ yr o c 

Below Cut 
No. 


Scores 
% 


3 


Reading 
Mathematics 


32,382 
23,539 


29.7 
21.5 


5,090 
3,359 


21.6 
14.3 


37,472 
26,898 


28.2 
20.2 


5 


Reading 
Mathematics 


26,320 
33,255 


23.5 
29.6 


3,489 
4,343 


15.6 
19.4 


29,809 
37,598 


22.1 
27.9 


8 


Reading 
Mathematics 


38,841 
35,384 


28.1 
25.6 


3,619 
2,492 


15.8 
10.9 


42,460 
37,876 


26.4 
23.5 


Total Reading 
Total Mathematics 


97,543 
92,178 


27.1 
25.6 


12,198 
10,194 


17.7 
14.8 


109,741 
102,372 


25.6 
23.9 




Table 8 
Noncategorical Students 
Numbers and Percentages of Scores 
At or Below Cut Scores 






Public Schools 


Nonpublic 


Schools 


Total Sample 


Grade 


Subject 


Scores at or 
Below Cut Scores 
No. X 


Scores at or 
Below Cut Scores 
No. X 


Scores 
Below Cut 
No. 


at or 
Scores 
% 


3 


Reading 
Mathematics 


27,606 
19,746 


26.8 
19.2 


4,819 
3,175 


20.9 
13.8 


32,425 
22,921 


25.7 
18.2 


5 


Reading 
Mathematics 


21,094 
27,771 


20.1 
26.5 


3,276 
4,173 


14.9 
19.0 


24,370 
31,944 


19.2 
25.2 


8 


Reading 
Mathematics 


31,900 
28,748 


24.7 
22.2 


3,441 
2,392 


15.2 
10.6 


35,341 
31,140 


23.3 
20.5 


Total 
Total 


Read Ing 
Mathematics 


80,600 
76,265 


23.9 
22.6 


11,536 
9,740 


17.1 
14.4 


92,136 
86,005 


22.8 
21.2 
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Table 9 
Total Tested Sample 
Numbers of Students Eligible 
for Reading Remediation Only, for Mathematics Remediation Only 
and for Remediation in Both Content Areas 











Both 


Number 


Percent 










Reading 


Eligible 


Eligible 






Reading 


Mathematics 


and 


For at Least 


For at Least 




Type of 


Remediation Remediation 


Mathematics 


One Remedial 


One Remedial 


Grade 


School 


Only 


Only 


Remediation 


Program 


Program 


3 


Public 


14,524 


5,681 


17,858 


38,063 


34.8 




Nonpublic 


2,841 


1,110 


2,249 


6,200 


26.3 


5 


Public 


6,515 


13,450 


19,805 


39,770 


35.4 




Nonpublic 


1,276 


2,130 


2,213 


5,619 


25.1 


8 


Public 


12,649 


9,192 


26,192 i 


48,033 


34.8 




Nonpublic 


2,000 


873 


1,619 


4,492 


19.6 


Total 


Public 


33,688 


28,323 


63,855 


125,866 


35.0 


Total Nonpublic 


6,117 


4,113 


6,081 


16,311 


23.7 










Table 10 












Noncategorical 


Students 










Numbers of Students Eligible 








for Reading Remediation Only, for 


Mathematics 


Remediation Only 






and for 


Remediation in 


Both Content 


Areas 












Both 


Number 


Percent 










Reading 


Eligible 


Eligible 






Reading 


Mathematics 


and 


For at Least 


For at Least 




Type of Remediation Remediation 


Mathematics 


One Remedial 


One Remedial 


Grade 


School 


Only 


Only 


Remediation 


Program 


Program 


3 


Public 


— : 

13,171 


5,311 


14,435 


32,917 


31.9 




Nonpublic 


2,718 


1,074 


;.,ioi 


5,893 


25.5 


5 


Public 


5,835 


12,512 


15,259 


33,606 


32.0 




Nonpublic 


1,192 


2,089 


2,084 


5,365 


24.4 


8 


Public 


11,740 


8,588 


20,160 


40,488 


31.3 




Nonpublic 


1,908 


859 


1,533 


4,300 


19.0 


Total 


Public 


30,746 


26,411 


49,854 


107,011 


31.7 


Total Nonpublic 


5,818 


4,022 


5,718 


15,558 


23.0. 
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Noncategoricat Student Score Distributions 



Figure 2 pictures the grade 3 distribution of reading tot&L scores for pubLic 
school students* Superimposed on this distribution is a norma L curve* The 
conclusion which resuLts from this comparison is that the scores on this test 
are not normaLly distributed* A similar concLusion would be reached about the 
other five TELLS instruments. 



Figure 2 

Distribution of Grade 3 Reading Scores 
Compared With a Normal Curve* 



Norma! Curve 

Grade 3 Reading 
Scores 




W 753 l«0&*2ftl 336 4111 44B #953405072 63tl 7045787189069629 9054627 

Number of Scorea 

♦The upper tall of the normal cam it abown extending beyond the hljbeet poeatble tett acorn. Talc It oMoucly an tmpoa, bllity. 
Howevar, for comparative parpoaaa the normal cam waa drawn wit* a mean of the aama magnitude aa that of the grcde 3 reading 
teat. Becaeee the teefa maaa waa ao alga, aa entire aomal carve coeld not be compfctteSy contained within the boandartea of the 
hlf beat poeetble teat acorn. 



The purpose of the comparison is tc show that the TELLS instruments do differ 
from many typical tests given to me* jure academic achievement* For the more 
typical types of tests relatively small numbers of students score well and 
relatively small numbers score poorly* with the majority scoring somewhare not 
far from the mean. This leads to a distribution of scores* which is normal in 
shape* 

The TELLS tests vera designed to contain content which would not be difficult 
for the majority of students* In fact* students answered correctly an average 
of between 69 and 76 percent of the items* depending upon the grade level and 
subject area (see Table 11)* This resulted in a score distribution in which 
Larger percentages obtained high scores than low scores* Pictured graphically 
this meant * concentration of scores above the mean* as shown in Figure 2* 



ERLC 



15 2i w^snsM 



Table 11 
Percentages of Items Answered 
Correctly on Each Test by NoncategoricaL 
Public Schoo 1 Students 



Grade 


Reading 


Mathematics 


3 


.70 


.76 


5 


.74 


.72 


8 


.73 


.69 



Because the concentration of scores occurred above the cut scores , not a Large 
number of students obtained scores right at these scores or only one point 
removed from them. In fact, for all six tests only two percent scored right 
at the cut scores and for five of the six tests only two percent scored one 
point above these. For the sixth test, grade 5 mathematics, three percent 
scored one point above the cut score* Thus, relatively few students were 
either placed in remediation or missed being placed in it because of only one 
or two questions. It should be remembered, also, that even though a partic- 
ular cut score had to be set, all students eligible for remediation answered 
incorrectly at least four out of 1C questions (see Table 1)* 

Results for Specific Objectives 

The numbers of objectives measured by the tests ranged from a high of 30 for 
grade 8 mathematics to a low or 13 for grade 3 reading. Depending upon the 
specific objective, grade level and subject area, between two and five items 
were used to measure each objective. 

Figures 3-8 were developed to provide a desc iption of student performance in 
terms of the percentages of items answered correctly for each objective. They 
are not intended to show strengths and weaknesses but rather to document dif- 
ferences across objectives. The committees of Pennsylvania educators who 
selected the objectives for each test were well aware that sorae objectives 
were more difficult than others for students of the grade levels tested. The 
national results confirmed this. Thus, the relative differences which 
occurred across objectives were anticipated beforehand* What could not be 
predicted accurately before testing were the percentages of items per objec- 
tive that Pennsylvania students were able to answer correctly and the degree 
to which some objectives were harder than others for Pennsylvania students. 

Reading Objectives 

Grade 3 

As shown in Figure 3, grade 3 students had the most difficulty overall with 
Literal Comprehension items and also found the Inferential Comprehension items 
to be relatively difficult. The objective for which the lowest percent cor- 
rect occurred (59 percent) was termed Stated Main Idea, i.e., identifies the 
sentence from the passage that best states the main idea of the passage. 

i. i6 22 



Students answered correctly over 70 percent of the items for all objectives in 

the areas of Vocabulary and Life/Study and Reference Skills. They had the 

least difficulty with items measuring their abilities to deaL with Multiple 
Meaning Words and with Reading Haps. 



In general, grade 5 students had the most difficulty with Inferential and 
Critical Comprehension and with Life/Study and Reference Skills (Figure 4). 
The objective for which their percentage correct was lowest (62 percent) was 
termed Main Idea, Paraphrase, i.e., selects the sentence that best paraphrases 
the main idea of a passage. Also among the most difficult were items relating 
to reading a road map. 

None of the objectives in the Literal Comprehension area were among the most 
difficult. In the area of Vocabulary, grade 5 students did well on the Multi- 
ple Meaning Words objective (36 percent correct) and also on the Categorizing 
objective, i.^., given a category title, selects a word group in which all 
words belong to the given categoty (86 percent correct). 



As was the case at the grade 5 level, grade 8 students had the most difficulty 
with items measuring Inferential and Critical Comprehension and Life/Study and 
Reference Skills (Figure 5). The lowest percentages answered correctly (61 
percent) wete for objectives measuring Reading Maps and Reading Schedules. 
Inferential and Critical Comprehension objectives for which the percentages 
correct were lowest were Drawing Conclusions and Details Supporting the Main 
Idea, i.e., selecting the sentence containing details that either support or 
do not support the stated main idea. 

Two of the objectives found easiest by students were in the Vocabulary area. 
Figurative Language/Metaphor was least difficult (84 percent correct). Also 
among those of least difficulty was Analogies (82 percent correct). In the 
Inferential and Critical Comprehension area, Distinguishing Fact from Opinion 
was tne least difficult (83 percent correct). 



At the grade 3 level students answered correctly over 90 percent of both Addi- 
tion Requiring No Renaming problems and Graphing problems requiring them to 
interpret bar graphs (Figure 6). In the Geometry area they answered correctly 
90 percent of the items requiring them to identify plane figures. 

The most difficult objective for grade 3 students was Subtraction with Renam- 
ing. Only percent of the items for this objective were answered correctly. 
Grade 3 students also had relatively more difficulty with story problems 
requiring them to add and subtract; with identifying equivalent numerals for 
pictured objects in groups of hundreds, tens and ones; and with interpreting 
pictographs. 



Grade S 



Grade 8 



Mathematics Objectives 



Grade 3 
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Grade 5 



As was the case at the grade 3 level, grade 5 students had little difficulty 
with questions about bar graphs (Figure 7). At this point in time Subtraction 
with Renaming had become a strength, as was the case for the Numeration objec- 
tives. Students aLso had relatively little trouble with story problems deal- 
ing with consumer mathematics • 

The most difficult objectives for grade 5 students were Conversions/Metric (45 
percent correct) and Division/One Digit Numbers (51 percent correct). Also 
difficult were Conversions/Customary (55 percent correct) and Multiplication 
by Two or Three Digits (56 percent correct). The general area of Fractions 
was a difficult one with, overall, 64 percent of the items of the four objec- 
tives ansvered correctly. 



In general, grade 8 students had the least difficulty with story problems and 
with Graphing, Statistics and Probability objectives (see Figure 8). Finding 
the sum or difference of two decimals through the thousands place was not at 
all difficult (90 percent of these items were ansvered correctly). As was the 
case at the other two levels, questions about bar graphs were routinely 
answered (88 percent answered correctly)* 

Overall, Measurement items were least often answered correctly. More specif- 
ically, items assessing conversions from customary measures to equivalent cus- 
tomary measures were among the most difficult (50 percent answered correctly). 
Dividing Decimals and finding areas were also relatively difficult. Finding 
Percent of a Number and Conversions/Metric were among the most difficult 
objectives. 



Grade 8 
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Figure 3 

PERCENT CORRECT BY OBJECTIVE 
GRADE 3 READING 



OBJECTIVES 
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OBJECTIVES 



Word Meanings Fronv Context 
Multiple Meanings 
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Main Idea, Paraphrase 
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PERCENT CORRECT BY OBJECTIVE 
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PERCENT CORRECT BY OBJECTIVE 
GRADE 3 MATHEMATICS 
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PERCENT CORRECT BY OBJECTIVE 
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OBJECTIVE 
Exponents 
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Adding/Subtracting Decimals — fltt&v&tt^v^ ' 
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TESTING RESULTS FOR GROUPS 



Through use of the additional information provided at the time of testing by 
students or their teachers, it was possible to summarize the results achieved 
by a number of different groups. This chapter contains such results for males 
and females, for Chapter 1 students, for special education students and for 
limited English proficiency students* Also presented is an analysis showing 
numbers of students identified by TELLS for remediation who were not previous* 
ly being served by special education, by Chapter 1 or by the limited English 
proficiency program. 

Male-Female Comparisons 

Tables 12 and 13 contain male-female comparisons for public and nonpublic 
schools, respectively. These tables summarize the fact that At all three grade 
levels and in both types of schools Larger percentages of boys than girls 
became eligible for reading remediation. This same trend existed for math* 
ematics at all three grade levels in public schools and at the grade 8 level 
in nonpublic schools. The percentages of nonpublic school males and female3 
who became eligible for mathematics remediation were approximately equal at 
the grade 3 and S levels. 

Chapter 1 Student Results 

Table 14 summarizes the ECIA Chapter 1 student results for both public and 
nonpublic schools. Overall, about two-thirds of the reading scores of stu- 
dents enrolled in Chapter 1 reading programs fell at or below the cut scores. 
About 60 percent of the mathematics scores of students enrolled in Chapter 1 
mathematics programs fell at or below the cut scores* Differences between 
public school and nonpublic school percentages were much greater for mathema- 
tics than for reading. 



Table 12 
Public School Males and Females 
Numbers and Percentages of Scores 
At or Below Cut Scores 



Reading Mathematics 

Scores at or Scores at or 

No. Below Cut Scores No. Below Cut Scores 

Grade Sex Tested No* Z Tested No. X 



3 


Female 


52,847 


13,471 


25.5 


52,902 


10,802 


20.4 




Male 


55,934 


18,762 


33.5 


56,052 


12,612 


22.5 


5 


Female 


54,592 


10,688 


19.6 


54,638 


14,994 


27.4 




Male 


57,363 


15,523 


27.1 


57,464 


18,149 


31.6 


8 


Female 


66,636 


J 7,473 


26.2 


66,615 


15,725 


23.6 




Male 


71,189 


21,251 


29.9 


71,150 


19,561 


27.5 



25 37 



Table 13 

Nonpublic School Males and Females 
Numbers and Percentages of Scores 
At or Below Cut Scores 









Reading 






Mathematics 




Grade 


Sex 


No. 
Tested 


Scores 
Below Cut 
No. 


at or 
Scores 
X 


No. 
Tested 


Scores 
Below Cut 
No. 


at or 
Scores 
Z 


3 


Female 
Hale 


11,853 
11,609 


2,186 
2,878 


18.4 
24.8 


11,851 
11,612 


1,689 
1,646 


14.3 
14.2 


5 


Female 
Hale 


11,330 
11,044 


1,545 
1,933 


13.6 
17.5 


11,330 
11,044 


2,169 
2,157 


19.1 
19.5 


8 


Female 
Hale 


11,838 
11,074 


1,776 
1,833 


15.0 
16.6 


11,836 
11,072 


1,150 
1,333 


9.7 
12.0 




Table 14 
Chapter 1 Students 
Numbers and Percentages of Scores 
At or Below Cut scores 






Public Schools 




Nonpublic Schools 


Grade 


Subject 


No. 
Tested 


Scores at or 
Below Cut Scores 
No. X 


No. 
Tested 


Scores at or 
Below Cut scores 
No. X 


3 


Reading 
Mathematics 


14,809 
4,978 


10,196 
2,533 


68.9 
50.9 


2,645 
1,308 


1,619 
525 


61.2 
40.1 


5 


Reading 
Mathematics 


12,225 
4,674 


7,462 
3,350 


61.0 
71.7 


1,640 
882 


937 
454 


57.1 
51.5 


8 


Reading 
Mathematics 


7,478 
3,132 


5,555 
2,223 


74.3 
71.0 


541 
566 


340 
255 


62.9 
45.1 


Total Reading 
Total Mathematics 


34,512 
12,784 


23,213 
8,106 


67.3 
63.4 


4,826 
2,756 


2,896 
1,234 


60.0 
44.8 



38 

26 



Table 15 

Public School l;:cial Education Students 
Numbers and Percentages of Scores At or Below Cut Scores 



Grade 3 Grade 5 Grade 8 

Scores at or Scores at or Scores at or 

No. Below Cut Scores No. Below Cut Scores No. Below Cut Scores 

Category Subject Tested No. Z Tested No. Z Tested No. Z 



Educable 
Mentally 
Retarded 


Reading 
Mathematics 


866 

854 


837 
811 


96.7 
91.7 


Hearing 
Impaired 


Reading 
Mathematics 


130 
135 


91 
53 


70.0 
39.3 


Learning 
Disabled 


Reading 
Mathematics 


3503 
3584 


2748 
2087 


78.4 
58.2 


Physically 
Handicapped 


Reading 
Mathematics 


61 
61 


26 
30 


42.6 
49.2 


Socially and 

Emotionally 

Disturbed 


Reading 
Mathematics 


453 
464 


331 
275 


73.1 
59.3 


Speech and 

Language 

Impaired 


Reading 
Mathematics 


3575 
3580 


1027 
674 


28.7 
18.8 


Other Special 

Education 

Category 


Reading 
Mathematics 


424 
437 


220 
195 


51.9 
44.6 



1035 


1002 


96.8 




lOJH 


qq n 


1050 


1021 


97.2 


1637 


1603 


97.9 


99 


50 


50.5 


168 


108 


64.3 


105 


36 


34.3 


168 


75 


44.6 


4393 


3221 


7j.3 


4969 


3967 


79.8 


4476 


3450 


77.1 


4966 


3868 


77.9 


55 


23 


41.8 


46 


16 


34.8 


55 


28 


50.9 


46 


18 


39.1 


642 


405 


63.1 


773 


555 


71.8 


640 


460 


71.9 


772 


591 


76,6 


1453 


397 


27.3 


272 


106 


39.0 


1455 


506 


34.8 


272 


73 


26.8 


350 


154 


44.0 


162 


87 


53.7 


363 


169 


46.6 


163 


69 


41.6 



9 

ERIC 



39 



40 



Table 16 

Nonpublic School Special Education Students 
Numbers and Percentages of Scores At or Below Cut Scores 



Grade 3 Grade 5 Grade 8 

Scores at or Scores at or Scores at or 

No. Below Cut Scores No. Below Cut Scores No. Below Cut Scopes 

Category Subject Tested No. X Tested No. X Tested No. X 



Educable 


Reading 


7 


7 


100.0 


Mentally 


Mathematics 


6 


6 


100.0 


nciitucu 










Hearing 


RpAri \ no 

mwMU J. ll£ 


11 
* * 






Impaired 


Mathematics 


12 


2 


16.7 


Learning 


Reading 


54 


37 


68.5. 


Disabled 


Mathematics 


54 


31 


57.4 


Physically 


Reading 


4 


2 


50.0 


Handicapped 


Mathematics 


4 


1 


25.0 


Socially and 


Reading 


4 


3 


75.0 


Emotionally 


Mathematics 


4 


3 


75.0 


Disturbed 










Speech and 


Reading 


341 


95 


27.9 


Language 


Mathematics 


285 


57 


16.7 


Impaired 










Other Special 


Reading 


63 


44 


69.8 


Education 


Mathematics 


64 


31 


48.4 


Category 











2 


2 


100.0 


2 


1 


50.0 


2 


2 


100.0 


2 


1 


50.0 


15 


10 


66.7 


3 


1 


33.3 


15 


7 


46.7 


3 


2 


66.7 


57 


35 


61.4 


31 


20 


64.5 


56 


36 


64.3 


31 


13 


41.9 


7 


4 


57.1 


5 


3 


60.0 


7 


5 


71.4 


5 


2 


40.0 


4 


3 


75.0 


4 


3 


75.0 


4 


1 


25.0 


4 


2 


50.0 


18 


32 


27.1 


39 


23 


59.0 


19 


38 


31.9 


39 


14 


35.9 


69 


31 


44.9 


35 


20 


57.1 


70 


34 


48.6 


36 


13 


36.1 
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SpeciaL Education Student Results 



Tables 15 and L6 (see pages 27 and 28) present the resuLts of the testing of 
special education students. As shown, almost all of the educable mentally re* 
tarded students who were tested scored at or below the cut scores. As expec- 
ted, results for speech and language impaired students did not differ greatly 
from those for all noncategorical students. For all other special education 
categories the percentages at or below the cut scores were much greater than 
were those for noncategorical students. 

Limited English Proficiency Student Results 

Table 17 summarizes the results of the testing of limited English proficiency 
students. As might be expected, the percentages of these students 9 scores 
falling at or below the cut scores were greater for reading than for mathema- 
tics. 



Table 17 

Limited English Proficiency Students 
Numbers and Percentages of Scores 
At or Below Cut Scores 



Public Schools Nonpublic Schools 









Scores 


at or 




Scores 


at or 






No. 


Below Cut 


Scores 


No. 


Below Cut 


scores 


Grade 


Subject 


Tested 


No. 


X 


Tested 


No. 


X 


3 


Reading 


836 


577 


69.0 


335 


180 


53.7 




Mathematics 


845 


386 


45.7 


336 


114 


33.9 


5 


Reading 


769 


440 


57.2 


314 


130 


41.4 




Mathematics 


787 


382 


48.5 


317 


86 


27.1 


8 


Reading 


971 


660 


68.0 


305 


136 


44.6 




Mathematics 


974 


475 


48.8 


306 


71 


23.2 


Total 


Read ing 


2,576 


1,677 


65.1 


954 


446 


46.8 


Total 


Mathematics 


2,606 


1,243 


47.7 


959 


271 


28.3 



Students Identified by TELLS Who Were Not 
Previously Being Served by Other Programs 

One measure of the impact of the TELLS program is the number of students now 
given access to a remedial program who were not previously being provided spe- 
cial help* A subtraction process was required to estimate this, taking away 
numbers of students being served by .special education, by Chapter I and by the 
Limited English proficiency program from the total number of students identi- 
fied by TELLS for at least one remedial program. The numbers which resulted 
from this subtraction are obviously estimates since it is not known how many 
students were being served in i*ocai remedial programs not identified as spe- 
cial education* Chapter I or limited English proficiency. 



The anaLysis which was performed is summarized in TabLe 18* As can be seen, 
the TELLS program identified for remediation 82,166 pubLic school students and 
12,295 nonpublic school students who were not previously being served by spe- 
cial education, Chapter 1 or the limited; English proficiency program* Thus, a 
total of 94,461 unserved students Here identified* 



Table 18 
Students Identified by TELLS 
Who Were Not Previously Served 



Type of 
Grade School 


Eligible 
Noncate** 
gorical (1) 


Total Eligible 
Noncategorical 
Chapter 1 (2) 


No. Eligible 
Who Were Not 
Not Being 
Served (3) 


3 Public 


32,298 


9,982 


22,316 


rionpuDi ic 


j f oZ7 


1,010 


4,217 


5 Public 


33,219 


8,169 


25,050 


Nonpublic 


5,338 


1,094 


4,244 


8 Public 


40,400 


5,600 


34,800 


Nonpublic 


4,283 


449 


3,834 


Total Public 


105,917 


23,751 


82,166 


Total Nonpublic 


15,448 


3,153 


12,295 


Total Grade 3 


38,125 


11,592 


26,533 


Total Grade S 


38,557 


9,263 


29,294 


Total Grade 8 


44,683 


6,049 


38,634 


Overall Total 


121,365 


26,904 


94,461 



(1) The numbers of students unserved by special education or the limited 
English Proficiency (LEP) program are equal to noncategorical students 
minus speech and language impaired* 



(2) The numbers of Chapter 1 students eligible for at least one remedial 
program who were not being served by special education or the LEP 
program* 

(3) Unserved by the LEP program, by Chapter 1 or by special education* 
This column was produced by subtracting column 2 from column 1* 
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ANALYSES OP RESULTS FOR EACH OBJECTIVE 



This seccion presents two types of analyses of test data. First, the results 
achieved on each objective by students whose scores fell above cut scores will 
be compared with those of students whose scores fell at or below cut scores. 
This analysis was performed to help identify the specific skill deficiencies 
which were most responsible for locating students in need of remedial help. 

The second analysis to oe described is similar to the first. The results for 
schools which had tre lowest percentages of students identified for remedi- 
ation will be compared with those of schools which had the highest percentages 
identified. These results will be examined in light of what was found on the 
first analysis to determine whether the content areas which were most respon- 
sible for identifying students for remediation were the same ones which most 
described differences across the two groups of schorls. 

Comparisons of Results for Students Above and Below the Cut Scores 

This analysis was performed using testing results for noncategorical students 
from public schools. For each of the six tests, students whose scores fell 
above the cut score formed one group and those whose scores fell at or below 
the cut score formed the. comparison group. For each of the two groups the 
percentages of students correctly answering each item were determined. For 
each group, then, the averages of the percentages correct for the items meas- 
uring aach objective were calculated. These average percentages correct for 
each objective are shown in Figures S-14. 

Reading Test Results 

Grade 3 

At the grade 3 level (Figure 9), the objective for which differences were 
greatest was Multiple Meanings, in the Vocabulary area. Students whose scores 
were above the cut score answered an average of 90 percent of these items cor- 
rectly. Students whose scores fell at or below the cut score answered cor- 
rectly, on the average, only 47 percent of the Multiple Meanings items. Other 
objectives for which the greatest differences occurred were Main Idea - Title 
and Predicting Outcomes, in the Inferential Comprehension area; Word Meanings 
from Context, in the Vocabulary area; and Stated Cause and Effect, in the 
Literal Comprehension area. 

The objective for- which the least amount of difference took place was Stated 
Main Idea in the Literal Comprehension area. The difference between the aver- 
age percentages correct for this objective was only .26 (.66 minus .40). 

Grade 5 

At the grade 5 level (Figure 10X, the area of Inferential and Critical Compre- 
hension was most descriptive of differences between above cut and below cut 
students. For all objectives of this area except Distinguishing Fact/Opinion, 
the differences between the average percentages correct of the two groups were 
greater than .40. For two other objectives of the test the differences 
between the averages of the two groups were above .40. These were Word 
Meanings from Context, in the area of Vocabulary, and Using an index, in the 
Life/Study and Reference area. \ + 




For two objectives, difference?) between the average percentages correct of the 
two groups were below .30. These were Categorizing (.25), in the VocabuLary 
area, and Reading Tables or Charts (.26), in the Life/ Study and Reference 
area. 

Grade 8 

As was the case for grade 5 students, grade 8 students above and below the cut 
score differed most in their abilities to correctly answer Inferential and 
Critical Comprehension items (Figure 11). In this area the greatest differ- 
ences existed on Drawing Conclusions items. Above cut students averaged 73 
percent of these items correct; below cut students averaged only 31 percent 
correct. Another Inferential and Critical Comprehension objective for which 
large differences occurred (.40) was Distinguishing Fact/Opinion. Other 
objectives which were among those showing the greatest differences were Recog- 
nizing Details, in the Literal Comprehension area, and Word Meanings from 
Context, in the Vocabulary area. 

On four objectives, differences between the groups of less than .30 existed. 
The smallest difference (.25) occurred on the Reading Diagrams objective of 
the Life/Study and Reference area. The other three were Multiple Meanings 
(.28) and Analogies (.29), in the area of Vocabulary, and Stated Cause and 
Effect (.29), in the area of Literal Comprehension. 

Mathematics Test Results 

Grade 3 

Overall at the grade 3 level (Figure 12) above cut and below cut students dif- 
fered most in the areas of Problem Solving and Numeration. The specific 
objectives for which the greatest differences occurred were Addition/Renaming 
(.46), Place Value/Whole Numbers (.46), Counting by Twos, Fives and Tens (.40) 
and Time (.39). 

There was little difference between the two groups on Addition/No Renaming 
items (.97 vs .86). Among the other objectives for which the smallest differ- 
ences occurred were Subtraction/No Renaming (.22), Length (.22), Comparing 
Whole Numbers (.23), Bar Graphs (.23) and Flane Figures (.23). 

Grade 5 

Figure 13 depicts the fact that grade 5 above cut and below cut students dif- 
fered most on items measuring multiplication, division and fractions. The 
specific objectives for which the greatest differences occurred were Picture 
Craphs (.42), Subtracting Fractions (.40), Adding Fractions (.38), Fractional 
Part of a Number (.36), Multiplication by Two or Three Digits (.36), 
Division/One-Digit Divisors (.36) and Story Problems/Money (.36). 

For four objectives, differences between the two groups' averages were .25 or 
less. These objectives were Bar Graphs (.15), Addition/Renaming (.18), 
Read/Write Standard Numerals (.25) and Point/Line/Angie/Piane/Figure (.25). 
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Grade 8 

At the grade 8 level (Figure 14) the area of Fractions again was a major 
determiner of above cut-below cut differences. Four of the seven objectives 
for which the largest differences occurred had to do with Fractions. These 
were Adding/Subtracting Fractions (.50), MuLtipLying Fractions (.45), Convert- 
ing Fractions/Mixed Numbers/Whole Numbers (.43) and Story Problems/Fractions 
(.45). Other objectives which were among those for which the Largest differ- 
ences occurred were Whole Numbers/ Exponents (.45), Story ProbLems/Averages 
(.42) and EquaL Ratios in Proportions (.46). 

The objective for which the smallest difference was computed was 
Adiing/Subtracting Decimals (.19). Among others for which relatively small 
differences occurred were Circle Graphs (.21), B*r Graphs (.23), Story Prob- 
lems/Too Much Information (.24) and Dividing Decimals (.24). 

Comparisons of Results for Schools with the Largest 
and Smallest Percentages At or Below the Cut Scores 

In order to obtain the data for this analysis, the 50 schools which had the 
greatest percentages of noncategorical students at or below the cut score and 
the 50 schools which had the smallest percentages of noncategorical students 
at or below the cut score were first identified for each test. Then, in a 
similar way to that just described for above cut and below cut students, aver- 
age percentages correct for each objective were computed for the two groups of 
schools. The results obtained in these comparisons >^re contrasted with those 
just described for above cut and below cut students to determine whether the 
greatest differences found in each analysis took plare for the same 
objectives. 

To reduce the complexity of this comparative study it was decided to report 
the results for each content area rather than for each objective. These re- 
sults are shown in Tables 19 and 20 for reading and mathematics, respectively. 

These tables show, first of all, that the differences between the two groups 
of schools were not of as great a magnitude as the differences between above 
cut and below cut students. This is due to the fact that the average percent- 
ages of items correct for the two groups of schools were computed using data 
for all noncategorical students tested at each grade level. Thus, each aver- 
age shown in the school analysis is based upon results for both students above 
the cut scores and students below the cut scores. 

Further examination of this data leads to the conclusion that the two types of 
analyses did not isolate exactly the same content areas as the ones for which 
the greatest differences existed. However, for all three grade levels the 
reading content area for which differences were greatest was the same in the 
two analyses. These areas were Vocabulary at the grade 3 level and 
Inferential and Critical Comprehension at both the grade 5 and 8 levels. 

The two analyses both identified Problem Solving as the greatest area of dif- 
ference in the grade 3 mathematics testing. At the grade 8 level, although 
the same one area was not identified as that showing the greatest difference, 
the three areas with the greatest difference were the same for the two ana- 
lyses. These were Whole Numbers/Exponents, Fractions and Pre-Algebra. 
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The grade 5 mathematics content areas for which the greatest differences 
occurred were not the same for the two anaLyses. The above cut-below cur. 
analysis identified Fractions as the area of greatest difference; the school 
*..alysis identified both Whole Numbers/Division and Geometry. Why the two 
analyses produced differing resuLts for this test or, for that matter, why 
they produced some divergence in resuLts for all tests is not clear at this 
point. It may be that the school analysis is more sensitive to such factors 
as curriculum differences. Further analyses of this type should help clarify 
these findings. 



Table 19 
Reading Content Areas 
Average Percentages Correct of Groups 
Compared in Two Analyses 



Student Analysis 



School Analysis 



Grade Content Area 



Above 

Cut/ 

Below 

Above Below Cut 
Cut Cut Differ- 

Students Students ence 



Smallest 

Schools Schools Percent 

with with Below/ 

Smallest Largest Largest 

Percents Percents Percent 

at or at or Below 

Below Below Differ* 

Cuts Cuts ence 



3 


Vocabulary 
Literal 


.85 


.45 


.40 


.86 


.58 


.28 




Comprehension 


.75 


.40 


.35 


.76 


.53 


.23 




Inferential 
















Comprehension 


.80 


.41 


.39 


.80 


.54 


.26 




Life/Study and 
















Reference 


.86 


.50 


.36 


.87 


.61 


.26 


5 


Vocabulary 
Literal 


.87 


.52 


.35 


.87 


.67 


.20 




Comprehension 


.82 


.46 


.36 


.82 


• .64 


.18 




Inferential/ 
















Critical Com- 
















prehension 


.80 


.40 


.40 


.81 


.59 


.21 




Life/ Study and 
















Reference 


.80 


.46 


.34 


.81 


.61 


.20 


8 


Vocabulary 
Literal 


.85 


.54 


.31 


.85 


.65 


.20 




Comprehension 


.86 


.51 


.35 


.85 


.67 


.18 




Inferential/ 
















Critical Com- 
















prehension 


.80 


.43 


.37 


.79 


.58 


.21 




Life/Study and 
















Reference 


.79 


.48 


.31 


.78 


.60 


.18 



Table 20 
Mathematics Content Areas 
Average Percentages Correct of Groups 
Compared in Two Analyses 





Student Analysis 


> 

School Analyi 


sis 














Smallest 










School 4 




Percent 








Above 


w *. til 


with 


Below/ 








Cut/ 


Snutl 1 p*t 


UAL (v. *• 


Largest 








Below 


Pprrpnf q 

Jfc CI 




Percent 




Above 


Below 


Cut 


at or 


At OP 
CI i. 


Below 




Cut 


Cut 


Differ- 


Below 


Below 


Dif r'er- 


Grade Content Area 


Students 


Students 


ence 


Cuts 


Cuts 


ence 


3 Whole Hon J 














Addition 


• 90 


.62 


.28 


.92 


.75 


.17 


Subtraction 


.76 


.50 


.26 


• 80 


.62 


.18 


Numeration 


• 84 


.49 


.35 


• 86 


.66 


.20 


Fractions 


• 75 


.44 


.31 


.78 


.60 


.18 


Measurement 


• 82 


.50 


.32 


• 84 


.65 


.19 


Problem Solving 


.76 


.39 


.37 


• 80 


.56 


.24 


Graphing 


• 82 


.56 


.26 


.85 


.65 


.20 


Geometry 


• 89 


.61 


•28 


.91 


.71 


.20 


5 Whole Nos./ 














Addition 


• 88 


.70 


.18 


.86 


.77 


.09 


Subtraction 


.93 


.67 


.26 


.91 


.77 


.14 


Multiplication 


.78 


.42 


,36 


.76 


.58 


.18 


Division 


• 61 


.25 


.36 


.63 


.43 


.20 


Numeration 


.92 


.63 


.29 


.91 


.72 


.19 


Fractions 


.74 


.37 


.37 


.74 


.58 


.16 


Measurement 


*73 


.46 


.27 


.73 


.58 


.15 


Problem Solving 


.82 


.51 


.31 


.81 


.65 


.16 


Graphing 


•94 


.65 


.29 


.93 


.74 


.19 


Geometry 


• 76 


.46 


.30 


.77 


.57 


.20 


8 Whole Nos*/ 








• 






Exponents 


.71 


.26 


.45 


.76 


.48 


.28 


Fractions 


.78 


.34 


.44 


.84 


.53 


.31 


Decimals 


.78 


.47 


.31 


.82 


.57 


.25 


Measurement 


.64 


.32 


.32 


.69 


.44 


.25 


Problem Solving 


.84 


.47 


.37 


.86 


.63 


.23 


Graphing/ 














Statistics/ 














Probability 


.81 


.53 


.28 


.84 


.62 


.22 


Geometry 


.78 


.48 


.30 


.83 


.57 


.26 


Pre- Algebra 


.79 


.41 


.38 


.83 


.55 


.28 


Ratio/Propor- 














t ion/Percent 


.73 


.36 


.37 


.77 


.51 


.26 
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GRADE 3 READING 
PERCENT OF ITEMS ANSWERED CORRECTLY 
BY TUO GROUPS 



OBJECTIVES 



Word Meanings From Context 
Mu 1 1 i p 1 e Mean ings 
Categor i z ing 

Recogn i z ing Detai Is 
Stated Cause And E-ffect 
Sequence Of Events 
Stated Main Idea 

Mam Idea, Title 
Story Elements. Character 
Implied Cause And Effect 
Pr ed i ct i ng Outcomes 

FoMotulpg Written Directions 
Reading Mips 
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VOCABULARY 
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.82 



,90 



,84 



LITERAL COMPREHENSION 
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,74 
-77 
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INFERENTIAL COMPREHENSION 
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44 1 
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.79 
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LIFE/STUDY AND REFERENCE 



46i 



53i 
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.88 
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Figure 10 



GRADE 5 READING 
PERCENT OF ITEMS ANSWERED CORRECTLY 
BY TWO GROUPS 



OBJECTIVES 
Word Meanings From Context 
Multiple Meanings 
Categor i 2 ing 

Recognizing Oetai Is 
Stated Cause And Effect 

Main Idea. Paraphrase 
Sequence of Events 
Predicting Outcomes 
Distinguishing Pact/Opinion 
Drawing Conclusions 
Implied Cause And Effect 

Using Dictionary Skills 
Reading Maps 
Using an Index 
Reading Tables or Charts 
Completing an Out I ine 



ABOVE CUT 



I [ BELOW CUT 



VOCABULARY 




LITERAL COMPREHENSION 

44' = 

48' 1 = 



i79 
i84 



INFERENTIAL/CRITICAL COMPREHENSION 



181 




LIFE/STUDY 4 REFERENCE 
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Figure 11 

GRADE 8 READING 
PERCENT OF ITEMS ANSWERED CORRECTLY 
BY TWO GROUPS 



OBJECTIVES 
Word Meanings From Context 
Mult; pit Mt an trigs 
Analog! ts 

Figurative Language/Metaphors 

Recognizing Details 
Stated Caust and Effect 

Main Idta, Paraphrase 
Predicting Outcomes 
Distinguishing Fact/Opinion 
Drawing Conclusions 
Imp I itd Caust And Efftct 
Details Supporting Main Idea 
Author* s Purpose 

Using Dictionary Skills 
Reading Maps 
Using An Index 1 
Reading Tables Cr Charts 
Reading Diagrams 
Reading Schedules 



ABOVE CLT 



j | BELOU CUT 



VOCAbULARY 



Sic 



*ll 




55 




1, 













*9 
■92 



LITERAL CGMPREKEN5 ION 



56c 



AC, 1 













,8? 
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INFERENTIAL/CRITICAL COMPREHENSION 

I — 



38= 

32= 



31« 
34= 



53* 



.86 



,73 
-76 



.71 



,86 
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Figure 12 



GRADE 3 MATHEMATICS 
PERCENT OF ITEMS ANSWERED CORRECTLY 
BY TWO GROUPS 



OBJECTIVES 

Addition/No Renaming 
Addi t i on/Renaming 
Subtraction/Basic Facts 
Subtraction/No Renaming 
Subtract i on/Renaming 

Count by Twos* Fives I Ttns 

Ptace Value/Whole Numbers 
Pictures/Standard Numerals 

Reid/Urite Standard Numerals 
Comparing Whole Numbers 

Fractional Regions 

Value of Money 

Time 

Length 

Reading Tables or Charts 

Story Problems/Add/Subtract 
Story Problems/Money 

Bar Graphs 
Picture Graphs 

P I ane F i gures 
Solid F i gures 



ABOVE CUT 



| | BELOW CUT 



WHOLE NUMBERS 




15c 

NUMERATION 
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4*. 




Ml 
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FRACTIONS 



44c 



MEASUREMENT 



72c 



PROBLEM SOLVING 



set 



GRAPHING 



74 



72c 



49c 



3 
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Figure 13 

GRADE 5 MATHEMATICS 
PERCENT OF ITEMS ANSWERED CORRECTLY 
BY TWO GROUPS 



ABOVE CUT 



OBJECTIVES 
Addi t i on/Renaming 
Subtract i on/Renaming 
Multiplication By 1 Digit 
Multiply By 2 Or 3 Digits 
D i v i s i on/l-Di gi t Divisors 

Read/Write Standard Numerals 
Place Value/Whole Numbers 

Fractional Regions 
Fractional Part Of A Number 
Adding Fract i ons 
Subtracting Fraction? 

Time 

Con vers I ons/Matr \ c 
Convers i ons/Customary 
Perimeter 

Story Problems/Basic Operations 

Story Problems/Money 

Story Problams/Consumar Math 



Bar Graphs 

P i cture Graphs 



82' 



Sol id Figures 

Po int/L ine/Angle/P lane/Figure 
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OBJECTIVES 
Exponents 



Figure 14 

GRADE 8 MATHEMATICS 
PERCENT OF ITEMS ANSWERED CORRECTLY 



WHOLE NUMBERS 
261 



ABOVE CUT 



Q BELOW CUT 



FRACTIONS 



Adding/Subtracting Fractions 

Mult.plying/Dividing Fractions 

At 1 Operat ions/Ml xed Numbtrs 

Comparing Fractions 

Convert Fract i ons/Mi xed/Uho It Numbers 



Adding/Subtracting Decimals 
Multiplying Decimals 
Rounding Decimals 
Dividing Decimals 
Convert Decimals to Fraction* 

Convers ions/Customary 
Con vers i ons/Metr i c 
A? ea 
Volume 

Perimeter And Circumference 

Story Problems/Fractions 
Story Problems/Averages 
Story Problems/Too Much Info 
Story Problems/Multi-Step 

C • rc te Graphs 
Probabi I i ty 
Bar Graphs 

L ine Relationships 
K inds of Angles 

Adding/Subtracting Integers 
Comparing Integers 

Equal Ratios in Proportions 

Convert Fract ions/Percents 
Finding Percent o? a Numbor 
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APPENDIX A: SELECTED SECTIONS , CHAPTER 3: STUDENT TESTING 
STATE BOARD OF EDUCATION REGULATIONS 



22 PA Code 
Chapter 3. Student Testing 

Section 3.1 Statutory authority* 
3*2 Compliance schedule* 

3.3 Definitions 

3.4 General purpose* 

3.5 TELLS testing program administration* 

3.6 Students to be exempted from TELLS testing program* 

3.7 Scope* 

3.8 Test administration security 

3.9 Confidentiality 

3.10 Nonpublic schools participation* 

3.11 Guidelines 

3.12 Reports 

*Presented below 

3 . 1 S tatutory authority 

The statutory authority for this chapter is found at section 290.1 of the 
Public School Code of 1949 (24 P.S. ss. 2-290.1) and sections 1317-1319 of 
The Administrative Code of 1929 (71 P.S. ss. 367-369). 



3.2 Compliance schedule 

(a) This chapter shalL become effective in the 1984-85 school term and 
thereafter. 

(b) The Testing for Essential Learning and Literacy Skills program (TELLS) 
testing program shall be given for the first time in the 1984-85 
school term in accordance with a schedule to be developed by the 
Secretary and shall continue on an annual basis. 



3.4 General purpose 

The TELLS program is designed to identify student competencies in the 
basic skill areas of reading and mathematics. 



3.5 TELLS testing prograa administration 

(a) Grade levels to be tested . Public school students, except those 
exempted in Section 3.6 ... enrolled in grades 3, 5 and 8 shall be 
tested in accordance with this chapter. 

(b) Type of testing . The tests in reading and mathematics c hall be 
of a criterion referenced type and shall be as prescribed by the 
Secretary. 

(c) Test selection . The Secretary will have the authority to develop 
the tests or to contract for the development of any portions of the 
tests and for related services necessary for the conduct of the 
testing program. 
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3.6 Students to be exempted from TELLS t esting program 

(a) Category exempt ions . The Secretary may exempt certain categories 

of students from the TELLS testing program when in the judgment 

of the Secretary exemption is merited* SchooL districts may submit 
written requests to the Secretary that additional categories of 
students be exempted. 

(b) Individual exemptions . Where the Secretary does not exempt a 
certain category of students from testing, a school district superin- 
tendent may grant exemptions to individual students based upon the 
individual educational program of such students and guidelines that 
the Secretary may issue. 

3.7 Scope 

(a) All public school districts shall participate in the TELLS testing 
program. 

(b) 

3.10 Nonpublic schools participation 

(a) Nonpublic schools which desire to participate in the TELLS testing 
program shall notify the Secretary in writing of their desire in 
accordance with the annual TELLS schedule to be established by the 
Secretary. 

(b) Nonpublic schools which choose to participate in the TELLS testing 
program shall conform to Department guidelines pertaining to the 
conduct and administration of the TELLS testing program. 
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APPENDIX B: APPLICABLE SECTIONS, ACT 93 



Portions of Act 93 are included here to help clarify the purposes of TELLS. 

Section 1511 • 1 - Remedial Programs* (a) Approved programs in 
reading and in mathematics shall be established by each school 
district for its public school students and by each intermediate 
unit for nonpublic school students to serve those students iden- 
tified as requiring assistance as a result of falling below an 
acceptable level of performance on tests developed and adminis- 
tered pursuant to regulations adopted by the State Board of 
Education. Annually, each school district and intermediate 
unit shall submit an application to the department for approval 
of a program of remediation services to be funded through funds 
distributed pursuant to subsection (b). Upon approval of the 
program, each school district and intermediate unit shall be 
eligible for State funds made available for such .programs, as 
provided in subsection (b). 

(b) Funds appropriated for remediation services and not 
distributed through sections 2501(19), 2502(d) and 25G2.5 
shall be distributed by the Department of Education to school 
districts based on the number of public school students iden- 
tified for reraediation and to intermediate units on behalf of 
nonpublic school students for remediation. Funds distributed 
to intermediate units shall be for services that are in addi- 
tion to any services provided in accordance with the provisions 
of section 922.1 and such funds shall be in addition to those dis- 
tributed in accordance with the provisions of section 922.1(d). 

Section 2502(d). For the 1983-1984 school year and each school 
year thereafter, each school district participating, during 
the 1984-1985 sch^ni. year and each school year thereafter, in a 
statewide program for testing and remediation which is designed 
to identify and provide remediation services to individual 
students pursuant to section 1511.1, shall be paid by the 
Commonwealth on account of instruction of the district's pupils 
an amount to be determined by multiplying the district's market 
value/income aid ratio by the factor for educational expense, 
one thousand seven hundred twenty-five dollars ($1,725), and 
by the weighted average daily membership of the district. This 
subsidy may be. used for strengthening curriculum, increasing 
standards, improving student achievement and providing remedial 
programs. 
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APPENDIX C: 1984 OBJECTIVES 



TELLS 
READING OBJECTIVES 



Grade 3 



VocabuLary 

SeLects the meaning of an unfamiiar word from the 

context of two given sentences. 
SeLects the meaning for a multiple-meaning word from 

the context of the sentence. 
Civen four words beLonging to the same category 

or a category title, selects the corresponding 

title or the four words belonging to the category. 

Literal comprehension 

Identifies a detail stated in a passage. 
Identifies the cause of an explicitly stated 

cause-effect relationship occurring within a passage. 
Identifies the event that happens first or last 

within a passage. 
Identifies the sentence from the passage that 

best states the main idea of the passage. 

Inferential comprehension 

Demonstrates comprehension of the main l aa by 

selecting the best title for a passage. 
Selects the implied feelings, motives, or traits 

of the character(s) within a passage. 
Selects the implied cause of a cause-effect 

relationship occurring within a passage. 
Determines the most probable outcome of a passage 

or of an event in a passage. 

Life/study and reference 

Given written directions describing a procedure with 
four steps, uses the directions to select the correct 
procedure. 




TKLLS 
READINC OBJECTIVES 



Grade 3 



Vocabulary 

Indicates which word or phrase best describes the meaning 
of an unfamiliar word inferred from the context of a 
passage. 

Selects the meaning for a multiple-meaning word from the 

context of the sentence. 
Given a category title, selects a word group in which all 

words belong to the given category* 

Literal comprehension 

Identifies a detail stated in a passage. 
Identifies the cause of an explicitly stated cause-effect 
relationship occurring within a passage. 

Inferential and critical comprehension 

Selects the sentence that best paraphrases the main idea 
of a passage. 

Selects the sequence of two or more events within a passage. 
Determines the most probable outcome of a passage or of 

an event in a passage. 
Determines whether a given statement is a fact or an opinion. 
Given a passage, selects the conclusion that can best be 

inferred from information stated in the passage. 
Selects the implied cause of a cause-effect relationship 

occurring within a passage. 

Life/study and reference 

Given two dictionary entries of homographs, selects the 
meaning of the word used in context and identifies 
appropriate guide words for the word. 

Given a road map containing a key and a compass, select r a 
direction, a distance or a location. 

Given an index with main topics, subtopics, and cross- 
references, selects the page numbers containing the 
requested information. 

Given a table that includes six rows under five categories, 
selects information from each category. 

Given a partially completed outline, selects the place in the 
outline where a given main topic or subtopic belongs. 
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TELLS 
READING OBJECTIVES 



Grade 8 

VocabuLary 

Indicates which word or phrase best describes the meaning of 

an unfamiLiar word inferred from the context of a passage. 
SeLects the meaning for a muLtipLe-meaning word from 

the context of the sentence. 
Given an incomplete sentence containing three words of an 

anaLogy, determines which of four words best completes 

the anaLogy. 

SeLects the two eLements of comparison in a sentence 
containing a metaphor. 

Lit era L comprehension 

Identifies a detaiL staged in a passage. 
Identifies either the cause or the effect of an 

explicitly stated cause-effect relationship occurring 

within a passage. 

Inferential and critical comprehension 

Selects the sentence that best paraphrases the 

msin idea of a passage. 
Determines the most probable outcome of a passage or 

of an event within the passage. 
Determines whether a given statement is an opinion. 
Selects the conclusion that can best be inferred from 

information stated in the passage. 
Selects the implied cause or the implied effect of a 

cause-effect relationship occurring within a passage. 
Selects the sentence containing details that either 

support or do not support the stated main idea. 
Determines the author's purpose for writing a passage. 

Life/ study and reference 

Given two dictionary entries of homographs , selects the 
meaning of the word used in contex and identifies 
appropriate guide words for the word. 

Given a road map containing a key, a scale and a compass , 
selects a direction, a distance or a location. 

Given an index with main topics, subtopics and cross- 
references, selects the page numbers containing the 
requested information. 

Given a table that includes nine rows under five categories, 
selects information from each category. 

Given a diagram of a passenger Liner with a key, seLects 
numbers or LabeLs in the diagram. 

Given a bus schedule, seLects information from the scheduLe. 
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TELLS 

MATHEMATICS OBJECTIVES 
Grade 3 

WhoLe numbers: addition 

Given either a two-digit and three-digit addend or two 3-digit 
addends, finds the sum without renaming (regrouping). 

Given two 2-digit addends, uses renaming (regrouping) once to 
find the sum. 

WViole numbers: subtraction 

Given a number Less than LO to be subtracted from a number 

Less than L9, finds the difference. 
Given a three-digit number and a two- or three-digit number, 

finds the difference without renaming (regrouping). 
Given a two-digit numbet and a one- or two-digit number, 

uses renaming (regrouping) once to find the difference. 

Numeration 

Given three or four numbers that require counting by twos, 

fives or tens, identifies the missing number. 
Given a designated digit in a standard numeraL through the 

thousands place, identifies the place of the designated dig 
Given pictured objects in groups of hundreds, tens, 

and ones (less than 1000), identifies the equivalent 

standard numeraL. 
Given a number through thousands written in digits and 

words, identifies the equivalent standard numeraL. 
Given two whole numbers Less than 1000, identifies which 

of the two whoLe numbers is either greater or Less. 

Fractions 

Given a shape with a shaded fractional part (haLves, thirds 
or fourths), identifies the fractional part shaded. 

Measurement 

Given pictured coins (haLf doLLars, quarters, dimes, 

nickeLs and pennies) and pictured one doLLar biLLs, finds 
the value of the money pictured. 

Given a pictured dock face showing time, identifies the 
correct time. 

Given a pictured object and a pictured ruLer, finds the Length 
of the object* 

Given a pictured caLendar month, identifies information about 
dates and days of the week* 

ProbLem soLving 

Given a story probLem requiring addition or subtraction, 

finds the sum or difference. 
Given a story probLem requiring the addition or subtraction 

of money, finds the sum or difference* 

(Continued) 
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(Grade 3 



- Continued) 



Graphing 

Given a bar graph scaLed by I, demonstrates an understanding 
of the graph by making identifications and comparisons* 

Given a picture graph (pictograph) scaLed by 2, 

demonstrates an understanding of the graph by making 
identifications and comparisons. 

Geometry 

Given a pictured circLe, rectangLe, square or triangLe, 

identifies the name of the shape. 
Given a pictured cone, cube, cyLinder or sphere, identifies 

the name of the shape* 
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TELLS 

MATHEMATICS OBJECTIVES 
Grade 5 

WhoLe numbers: addition 

Given three 4-digit addends or four 3-digit addends, uses 
renaming (regrouping) to find the sum. 

WhoLe numbers: subtraction 

Given two 4-digit numbers, uses renaming (regrouping) 
to find the difference. 

WhoLe numbers: muLtipLication 

Given a three- or four-digit factor muLtipLied by a 
one-digit factor, uses renaming (regrouping) to find 
the product. 

Given a three-digit factor muLtipLied by a two- or 

three-digit factor, uses renaming (regrouping) to find 
the product. 

WhoLe numbers: division 

Given a three-digit dividend and a one-digit divisor, finds 
the quotient with or without a remainder. 

Numeration 

Given a number through hundred thousands written in words, 

identifies the equivalent standard numeraL. 
Given a designated digit in a standard numeraL through the 

hundred thousands pLace, identifies the pLace of the 

designated digit. 

Fractions 

Given a shape with a shaded fractional part (fifths, sixths, 
sevenths, or eighths), identifies the fractional part shaded, 

Given a fraction and a whoLe number, finds the fractional 
part of the whoLe number (e.g., l/S of 25 * ). 

Given two fractions Less than 1 with Like denominators, 
finds the sum. 

Given two fractions Less than 1 with Like denominators, 
finds the difference. 

Measurement 

Given a pictured dock face showing time in five-minute 
or one-minute intervaLs, identifies the correct time. 

Given a metric measure, finds the equivalent metric 
measure. 

Given a customary measure (e.g., 1 in., 1 Lb., L qt.), 

finds an equivalent customary measure. 
Given a polygon with its dimensions shown, finds the perimeter. 



(Continued) 
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(Grade 5 - Continued) 
Problem soLving 

Given a story probLem requiring addition, subtraction, 
muLtipLical'ion or division, finds the sum, difference, 
product or quotient* 

Given a story probLem requiring the addition, subtraction- 
multiplication or division of money, finds the sum, 
difference, product or quotient* 

Given a menu listing items and prices and story problems 
requiring the addition, subtraction or multiplication 
of money, finds the sum, difference or product. 

Graphing 

Given a bar graph scaled by 1, demonstrates an understanding 
of the graph by making identifications, comparisons 
and calculations* 

Given a Labeled picture graph (pictograph) scaLed by 10, 
demonstrates an understanding of the graph by making 
identifications, comparisons and caLcuLations* 

Geometry 

Given a pictured cone, cube, cyLinder, rectangular prism 
or sphere, identifies the name of the shape* 

Given a point, Line, angLe, or pLane figure, identifies the 
name of the shape or figure. 
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TELLS 

MATHEMATICS OBJECTIVES 



Crade 8 



Whole numbers: multiplication 

Given a one-digit number with an exponent, finds the 
equivalent standard numeral* 

Fractions 

Given two fractions less than 1 with unlike denominators, 
finds the sum or difference. 

Given t"o fractions less than 1 or a fraction less then 
1 and a whole number, finds the product or quotient. 

Given two mixed numbers, finds the sum, difference, 
product or quotient. 

Given two fractions with unlike denominators and the 
symbols for greater than, less than and equal to, 
compares the two fractions and identifies the symbol 
that describes the relationship between the fractions. 

Giver' a fraction greater than 1 or a mixed number, 

finds the mixed number or whole number for the given 
fraction or the fraction for the given mixed number. 



Given two decimals through the thousandths place, 

finds the sum or difference. 
Given two decimals, finds the product that does not 

exceed the ten thousandth place. 
Given a decimal., selects the number that is the rounded number 

to the nearest tenth or hundredth for the given decimal. 
Given a dividend through the ten thousandths place and 

a divisor through the hundredths place (both decimals have 

a digit in the ones place), finds the quotient to the 

nearest tenth and hundredth. 
Given a decimal through tenths, hundredths or thousandths, 

identifies the equivalent fraction in lowest terms. 

Measurement 

Given a customary measure (e.g., 15 in., 15 lb., 15 qt.), 

finds an equivalent customary measure. 
Given a metric measure, finds the equivalent metric measure. 
Given a square, rectangle, triangle, parallelogram 

or circle with its dimensions shown and 3.14 for pi, 

finds the area. 

Given a pictured rectangular prism or cube with its dimensions 

shown, finds the volume. 
Given a polygon or circle with its dimensions shown 

and 3.14 foir pi, finds the perimeter or circumference. 



Decimals 
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(Grade 8 - Continued) 
ProbLem soLving 

Given a story probLem requiring addition, subtraction, 

multiplication or division of fractions or mixed 

numbers, finds the sum, difference, product or quotient. 
Given a story probLem with a sequence nf no more than 

six numbers, finds the average. 
Given a story problem with too much information, 

requiring addition, subtraction, muLt ipLication or 

division, finds the answer. 
Given a story probLem with whoLe numbers, fractions or 

decimaLs (including standard doLLar notation) requiring 

more than cne step, finds the answer. 

Graphing, statistics and probability 

Given a circLe graph nith percents, demonstrates an 
understanding of the graph by making comparisons and 
caLcuLat ions. 

Given a Listing of the possible outcomes of an event, 
finds the probability requested. 

Given a bar graph scaled by LO, demonstrates an under- 
standing of the graph by making identifications, com- 
parisons and calculations. 

Geometry 

Given a pair of lines, identifies nh? best name of 
the relationship between the Lines (intersecting, 
paraLLel or perpendicuLar). 

Given an angle, identifies the kind of angLe shown 
(acute, obtuse or right). 

Pre~algebra 

Given a one-digit integer and a two-digit integer 
and operation sign, finds the sum or difference. 

Given two integers and the symboLs for greater than, 
less than and equal to, compares the two integers 
and identifies the symbol that describes the relation- 
ship between the integers. 

Ratio, proportion, and percent 

Given a proportion in which one of the ratios has a 
missing number (e.g. 18/24 = y/20), finds the value 
of the unknown. 

Given a fraction (Less than one), a decimal (through 
hundredths place) or a percent (no greater than 99Z), 
changes the given fraction or decimal to a percent or 
changes the given percent to a fraction or decimal. 

Given a problem with the percent known and the number 

known (e.g., Find L2Z of L44), finds the unknown percent 
of the number (part). 
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APPENDIX D: SAMPLE kE PORTS . 



DISTRICT REPORT (1 bound copy and 1 unbound copy) 

SAMPLE A: District Performance Frequency and Summary, 
Summary Report Page 1' of 4 

This sunacary is a Listing, for each grade for 
reading and mathematics, of the following ! 

a. Raw scores - number of items correct 

b. District count - number of students obtaining each score 
District pet - percentage of students obtaining each score 

c. District percent - cumulative percentage of students in 
district obtaining up to each score point. For example, 
a percentage of 56 opposite a raw score of 41 means that 

56 percent of the students in the district scored 41 correct 
or less. The percentages of regular students falling below 
the cutoff score can be obtained by using columns a and c. 

d. National percent - estimated cumulative percentage of 
students in a national sample obtaining up to each score 
point. For example, a percentage of 68 opposite a raw 
score of 41 means 68 percent of the students in a national 
sample scored 41 correct or less. Comparing this to the 
district in the example abov 9 the district scored setter 
than the national sample. 

SAMPLE B: District Performance Summary by Groups, 
Summary Report Page 2 of 4 

This summary is a Listing, for each grade for 
reading and mathematics, of the following: 

a. District student count - number of students tested in each 
category (group) 

b. Average number of items correct, district - by each group tested 
and Listed 

c. Percentage of items correct, district * by each group tested 
and Listed 

d. Top Quart iLe Point Q3 - the number and percentage of items 
correct for the student who is above 75 out of 1Q0 students in 
the district 

Median MDN - the number and percentage of items correct 
for the student who is at the median or is above 50 out of 
100 students in the district 

Bottom Quartile Point Ql - the number and percentage 
of items correct for the student who is above 25 out of 
100 students in the district 

NOTE: The SLI, Chapter I Reading and Chapter I Mathematics 
figures are listed separately but are also included with 
non-categorical students above and the calculations for pages 
L, 3 and 4. Categorical Students are Listed separately and' are 
not included in the calculations above or for pages 1, 3 and 4. 
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SAMPLE C: District Objectives Performance Summary, Reading 
Summary Report Page 3 of 4 

For each objective, this report Lists the following: 



a* Number of students tested 

b. Average number of items correct in the district 

c. Average number of items correct in the national sample 

d. Percentage of students by number of iuems correct. For example, 
a 13 in a -2- column means that 13 percent of the students in the 
district had 2 items correct out of 5 total possible for that 
objective* 

e. Number of items by objective - the total possible for the 
objective 

f . District percentage of items correct - percentage of items 
correct out of the total possible for the district 

g. National percentage of items correct - percentage of items 
correct out of the total possible for a national sample 



SAMPLE D: District Objectives Performance Summary, Mathematics 
Summary Report Page 4 of 4 

This page has the same information for mathematics as page 3 
has for reading. 

(NOTE: The letters —A— through — P— on these pages refer 
to positions to locate labels which can be attached later to 
provide state normative data.) 



SAMPLE E: District Ranked Lists - 

Pages following District Summary 



Rank order list - For district by grade, this rank order list 
, shows student names with background data in the sequence from 
low to high score for reading and in similar sequence for 
mathematics. This list will' enable the district to determine 
the number of remediation cases in each subject once the 
cut scores have been set as well as categorical information 
about those students. Worksheets will be provided for this purpose. 
In the column headed "RM", an "R" indicates that the student reported 
that he or she was in a Chapter I Reading program and an "M" 
indicates participation in a Chapter I Mathematics program. 
In the column headed "SSL", a single ,, Y M indicates that one of the 
two language proficiency items had a positive response; a double 
"Y" indicates both items had a positive response. A student 
with a double "Y fV was classified as Limited English Proficient 
for purposes of scoring. In the column headed "SB" are each 
of the special education student codes. (SLI are not counted 
as special education categorical students and were included in 
the scoring as regular students.) 



SAMPLE F: District Roster of Scores 




District roster - For district by grade, this roster 
lists students alphabetically and gives the number and percent 
of itr correct in reading and mathematics and number of items 
correct by objective. Also, background information and student 
codes are shown. 
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STUDENT REPORTS (2 copies for schooL, 1 copy for parents; I label) 

SAMPLE G: Student reports for the school 

These reports are being delivered to the district for distribution 
to the school* One of the two copies should be placed in the 
student's permanent- file; the second copy is available for remediation 
pLanning* Included on the report are the student's number and 
percent of items correct in reading and mathematics with comparisons 
to district and estimated national percentages* For special educa- 
tion students • the district and national percentages are omitted 
and an "NA" is substituted* Also shown is the achievement of the 
student by objective* 

SAMPLE H: Parent report 

These reports are being delivered to the district for distribution 
to the parent via the school and student; they are attached to 
the student reports* The method of distribution to the parents 
should be similar to the measures used for delivery of report 
cards* Each contains the student's number and percent of items 
correct in reading And mathematics with comparisons to district 
and estimated national percentages* Also included is an explanation 
to the parent of the program and the scores* 

SAMPLE I: Student labels 

These labels are being delivered to the districts to be 
distributed to the schools* They should be placed on the 
student's permanent file folder* They contain the number and 
percent of items correct in reading and mathematics with 
comparisons to district and estimated national percentages* 

SCHOOL REPORTS (I bound copy and I unbornd copy per school) 

SAMPLE J i School Report 

These reports are similar to the district reports described above 
except that data are presented by school instead of by district* 
District data are included for comparisons* On page 2 of 4, all 
calculations, except student count are excluded because the smalL 
number of students iu many buildings may create unfair comparisons* 
If there is only one school at a grade level in the district* the 
figures for the school may be obtained from the district report* 
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OISTRICT PERFORMANCE SUMMARY BY GROUPS 
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DISTRICT OBJECTIVES PERFORMANCE SUMMARY 
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Earlier this vear vour child was tested in Reading and Matnematics as part of the Pmmylvanla statewide 
tSS^JSSJ^S^^^ as Testino for Essential Learning and Literacy Skills (TELLS). This report is 
intended to inform you of the results of those tests. 

As you can see from the TEST SCORES box above, the Reading test was made up <■ items. Your child's i perf or- 
mance on that est is ; Hsted as the number of items answered correctly out of the *2. Likewise here : were 63 
Stems oS the Mathematics test, and your child's performance is listed as the number correct out of the 63. On the 
next line, these numbers have been converted into percent of items answered correctly. 

These oercents allow you to compare your child's perfcmance to that of all the other third grade students in your 
SStofS i ?he DISTRICT AVERAGE section of the TEST SCORES , box) .You can f"™?"**™^*^ 
vour district's scores to an est mated nat ona percent correct (in the NATIONAL AVERAGE section of me i cat 
SCORES box) If you have questions about the meaning or uses of these scores, please contact your ch.ld s 
school. 
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